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Abstract 

In this paper we examine how simple agents similar 
to Braitenberg vehicles can exhibit chaotic movement 
patterns. The agents are wall following robots as 
described by Steve Mesburger and Alfred Hubler in 
their paper "Chaos in Wall Following Robots" . These 
agents uses a simple forward facing distance sensor, 
with a limited field of view (<&) for navigation. An 
agent drives forward at a constant velocity and uses 
the sensor to turn right when it is too close to an 
object and left when it is too far away. 

For a flat wall the agent stays a fixed distance from 
the wall and travels along it, regardless of the sensor's 
capabilities. But, if the wall represents a periodic 
function, the agent drives on a periodic path when 
the sensor has a narrow field of view. The agent's tra- 
jectory transitions to chaos when the sensor's field of 
view is increased. Numerical experiments were per- 
formed with square, triangle, and sawtooth waves for 
the wall, to find this pattern. The bifurcations of the 
agents were analyzed, finding both border collision 
and period doubling bifurcations. 

Detailed experimental results will be reported in 
the final version. 
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1 Introduction 

In this paper we look at how a simple wall following 
system leads to chaos, when modeled as a mathe- 
matical system. This shows the importance of un- 
derstanding chaos in the creation of artificial intelli- 
gences for robots. The model was originally described 
in the paper "Chaos in Wall Following Robots" by 
Steve Mesburger and Alfred Hubler. A model for 
a simple wall following robot was described and it 
was shown that when following a sinusoidal wall the 
robot's behavior would undergo a transition to chaos 
via period doubling as the robot's field of view in- 
creased [2] . In this paper we extend this research by 
walls with discontinuous corners and show that the 
robot still experiences a transition into chaos. 

2 Model 

The model for this simulation is small robot agent 
with an independent drive train and a simple forward 
pointing boundary sensor [2]. An independent drive 
train allows the vehicle to turn in place by driving 
the wheels on each side in opposite directions. The 
boundary sensor is only able to minimum distance to 
the boundary and not the shape or direction of the 
boundary. 

Furthermore the sensor has field of view limited 
to 2$. Where $ is one of parameters varied in the 
experiment. 

The most unrealistic part of this robot is that it 
can change its angular velocity (the rate at which it is 
turning) instantaneously, allowing the robot to switch 



^commonly found on tanks and the Mars Exploration 
Rovers 
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from a hard left turn to a hard right turn and back. 
This can happen when the robot's sensor detects a 
wall at the edge of it's vision and then turns or moves 
away from the wall. This is not physically possible 
but as long as the speed is low this approximates how 
real vehicles behave. For the purpose of modeling 
the robot also maintains a constant velocity which 
we convivially set to one. 

As such the robots position can be represented by 
an {x,y,9) vector where 6 is the counter-clockwise 
angle of the robot's direction of travel from the pos- 
itive X-axis. The velocity of the robot is represented 
by V and the angular velocity is u. (this makes the 
last equations somewhat trivial) The robot can the 
be represented as a series of deferential equations [2] . 
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Also the model dose not enforce the boundary by 
preventing the robot from crossing it. So it may be 
better to think of the boundary as the edge of a no 
entry zone for the robot instead of a physical barrier. 

The boundary is modeled as one of the waves. The 
wave travels along the X axis with an amplitude of 
one and a wavelength (A) of 10. There waves are 
studied in this paper, the square wave, the triangle 
wave and the sawtooth wave. A sinusoidal wave has 
been studied previously [5]. 

These waves can be represented using the following 
equations. 



Vtriangieix) = arcsin(sin(2;) ) 



(4) 
(5) 
(6) 



However, for efficiency of the calculations, and 
because the boundaries the vertical disjoint parts 
of the wave are part of the boundaries each wave 
was represented as a series of points represent- 
ing one period of the wave. (Actually more than 
one period is represented to avoid issues with 
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Figure 1: Four common types of waves. The triangle, 
square, and sawtooth waves were the focus of this 
study. 

the robot around the boundaries.) For exam- 
ple the square wave with A being the wavelength 
was represented by the following series of points. 
(-.5A, -1), (0, -1), (0, 1), (.5A, 1), (.5A, -1), (A, -1) 

3 Procedures 

A model for the robot was created using 
Mathematica"^^ . Each step of the robot was 
calculated using Rungc-Kutta 4 with a Ai = 0.1. 
Smaller values for At did not improve the results 
significantly. 

The largest calculation of the problem it to deter- 
mine the sensor value, or the minimum distance to 
the boundary. For the each segment of the wall with 
the robot's range the closest point to the robot was 
calculated as well as any intersections with the edges 
of the robot's field of vision. The closest of all these 
points was then used to calculate the sensor value. 

R represented the maximum range of the sensor, r 
represented the range at which the robot would move 
straight or how far it tried to say away from the wall. 
A scaling value a of the angular velocity might also 
be appropriate. Finally $ was half of the robot's 
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angular vision, it could range (0,7r]. R was taken to 
be 4, r was taken to be 3, and a was taken to be 1.0 

The results were then graphed on X-Y, X-0, Y-Q. 
With the X values were taken modulo A (10) so that 
they coincided with the period of the boundary. 

3.1 Calculation of Sensor Value 

In order calculate the closest point on the boundary 
to the robot agent with in it's sensor range several 
different distances were calculated and the minimum 
of them was used. The first, trivially, distance is the 
maximum range of the sensor R. Secondly the dis- 
tance to each selected points on the boundary that 
have been tested to be in the robot's sensor range. 
These points are divided into two further groups, 
points on the intersection of the boundary and the 
edge of the robot's vision, and the closest point on 
each segment to the robot's location. It can be shown 
that these points will always contain the closest point 
to the robot within its vision. 

The point on a segment closest to another point 
(the robot's location in this case) was found us- 
ing parametric equations to reduce machine round- 
ing errors and minimize the calculation time. 
|(s.-.i)x(p-.i)l ^ y Then: 

|S2-S1 1^ 
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Figure 2: Plot of the robot following a sawtooth 
wave, when $ ~ 1/QAtt. Notice how the robot is 
willing to follow the straight segment as long as it 
goes. 




51 if u < 

52 if u > 1 

^ (s2 — si)u + si i/0 < u < 1 

These points are then tested to make sure that they 
have the right angle from the robot to be seen by 
its sensors and are close enough to the robot to be 
seen. Point that are not in the robots sensor range are 
removed. Each segment is then tested to see if any 
point on it intersects with either edge of the robot's 
sensor range. The intersection of segments [pi,p2) 
and (p3,P4) was then found by:[l]. 

^ ^ (x4 - X3){yi - ys) - (j/4 - y3){xi - xg) 
(^4 - y3){x2 - xi) - (x4 - X3){y2 - yi) 

(7) 

intersection = pi + u{p2 — pi) (8) 



Figure 3: Plots of the xy movement when the sensor 
range $ = l/647r, R — A and r in the range [1.5,3.5]. 

4 Numerical Results 

The tree different boundary waves all followed the 
same pattern as $ increased from to tt When (f> 
was close to zero the robot tends to hug the wall very 
closely. In places where the is a long straight wall 
with no obstacles you can see the robot follow the 
wall all along it's path. The figures here were made 
by taking the point form each time step and plotting 
(x mod A, y) where A = 10 in this case. You also 
see the robot tends to head directly for corners, just 
narrowly passing them and then quickly stabilizing 
on the segment. Furthermore as R remains constant 
decreasing r causes the robot to follow the wall more 
closely. However when r = R the robot no longer 
turns counter clockwise. Similarly when r — the 
robot will only turn counter clockwise. Both of these 
cases are less interesting as the robot tends to either 
go in circles or drive off in a straight line. 

As the value of $ increases robot's path becomes 
slightly chaotic. While the robot's path remains in a 
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Figure 4: Path of robot against the sawtooth wave 
show in experience chaos even at low values of $. 




Figure 5: Cobweb diagram of the robot's y position 
when as it passes a point where x mod A = 0. The 
plot show log(y + 2.65) as this makes the lower left 
hand section of the graph easier to read. 

very narrow, and stable channel within that channel 
the path is chaotic. With the sawtooth wave this be- 
havior becomes most pronounced when $ « 197r/64 

Verhulst diagrams or more commonly cobweb plots 
were created of a single path to better view robot's 
behavior. To do this a point from each period of the 
robot's path was selected. For simplicity the points 
were when the x-coordinate was a multiple of the 
wavelength of the boundary. Then either the y ov 9 
values could be used to make the Verhulst diagram. 
The y value was chosen arbitrary. 

In fact it was found that the robot tends to exhibit 



Figure 6: A Bifurcation diagram of sawtooth wall 
showing a transition to chaos through period dou- 
bling 

this chaotic behavior even at low $ where it appears 
stable. This may be a property of having sharp cor- 
ners in the boundary wave that are not present in a 
sinusoidal wave. 

For all three waves the chaotic patterns appeared 
to die down around $ « .Stt. Then after that all three 
waveforms undergo a transition to chaos. To view the 
transition bifurcation diagrams were created for each 
type of wall. Like the Verhulst diagrams the value 
of y at the when a; is a multiple of A(10) were taken 
from each simulation of the robot. The first 30% of 
the values were discarded to ensure that the system 
and converged to it's attractor. 

The sawtooth boundary produced an period dou- 
bling bifurcation diagram. Where the full transition 
to chaos occurred when $ « 121/1287r However an 
exception was also found when $ = 15/167r. The 
robot moved in the negative direction by turning 
counter clockwise in ellipses. It may be that this is 
another attractor for the sawtooth boundary regard- 
less of the $ value. 

When the robot was following a triangle wave it 
was found that the 6 values provided a better bi- 
furcation diagram than the y values. The triangle 
wave boundary first cause chaotic behavior around 
<& « 3/167r The sharp disconnect when $ w 3/47r in 
the bifurcation diagram appears to be an indicator of 



Figure 7: A plot of the robot's movement backwards 

along a sawtooth boundary. Figure 8: A Bifurcation diagram of triangle wall 



a second attractor. 

The square boundary gave results looking more 
similar to that of the triangle wave then the sawtooth 
wave. It's first expression of chaos occurs around 
(f> « 7r/4 Also around 49/647r it too has a dis- 
connect, with initial starting values of (0,-2,0). In 
order to make the bifurcation diagram simulations 
were run for each $ value with a starting points at 
(0, y, 0) where for every half unit between —1 and —5. 
These two strange attractors actually curl around 
each other when visualized in 3d. 



5 Conclusion 

In this work it was show that the behavior of a simple 
control system can under go a chaotic transition from 
a change in the environment. A consistent pattern 
was still observable through out these changes. 

Further improvements to the algorithm could be 
made by creating a spatial hash table of segments 
that maps the location of the robots to a list of seg- 
ments that are with in the range of the robot. This 
would reduce the number of tests the simulation per- 
forms by as much as 50%. 
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Figure 9: A Bifurcation diagram of Square wall 
showing a very sharp transition around $ = ^ ss 2.3 
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Figure 10: A Poincarc Plot ol the y and 9 values 
when X is multiple of 10. 

6 Future Work 

Further work beyond optimizations of the algorithm 
involve adding additional robot agents for make a 
swarm. The swarm of wall following robots would 
interact with each other and the wall, which leads to 
a rich dynamical system. Research on the conditions 
when the swarm behaved chaotically and when it did 
not would be done. 

• Build a swarm of wall following robots 

• Experiment with different cognitive behaviors in 
the agents 

• Use agents with differing abilities in both sensors 
and cognition 

• Combine real and virtual robot agents in a sim- 
ulation 
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